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Abstract 

This article deals with variational optimal-control problems on time 
scales in the presence of delay in the state variables. The problem is 
considered on a time scale unifying the discrete, the continuous and the 
quantum cases. Two examples in the discrete and quantum cases are 
analyzed to illustrate our results. 
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1 Introduction 

The calculus of variations interacts deeply with some branches of sciences and 
engineering e.g. geometry, economics, electrical engineering and so on [16j . Op- 
timal control problems appear in various disciplines of sciences and engineering 
as well [ig. 

Time scale calculus was initiated by Hilger ( see ref. [13] and the references 
therein) having in mind to unify two existing approaches of dynamic models- 
difference and differential equations into a general framework. This kind of 
calculus can be used to model dynamic processes whose time domains are 
more complex than the set of integers or real numbers [TU] . Several potential 
applications for this new theory were reported (see for example Refs.|10|. [4], 
[T^ and the references therein) . Many researchers studied calculus of variations 
on time scales. Some of them followed the delta approach and some others 
followed the nabla approach (see for example Refs. [T7], [13], [5], [TH], [1] and 

m)- 

It is well known that the presence of delay is of great importance in applica- 
tions. For example, its appearance in dynamic equations, variational problems 
and optimal control problems may affect the stability of solutions. Very re- 
cently, some authors payed the attention to the importance of imposing the 
delay in fractional variational problems [5]. The non- locality of the fractional 
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operators and the presence of delay as well may give better results for prob- 
lems involving the dynamics of complex systems. To the best of our knowledge, 
there is no work in the direction of variational optimal-control problems with 
delayed arguments on time scales. 

Our aim in this article is to obtain the Euler-Lagrange equations for a 
functional, where the state variables of its Lagrangian are defined on a time 
scale whose backward jumping operator is p(t) = qt — h, q > 0, h > 0. This 
time scale, of course, absorbs the discrete, the continuous and the quantum 
cases. The state variables of this Lagrangian allow the presence of delay as 
well. Then, we generalize the results to the n-dimensional case. Dealing with 
such a very general problem enables us to recover many previously obtained 
results [a [111 Hill]. 

The structure of the article is as follows: 

In section 2 basic definitions and preliminary concepts about time scale 
are presented. The nabla time scale derivative analysis is followed there. In 
section 3 the Euler-Lagrange equations into one unknown function and then 
in the n-dimensional case are obtained. In section 4 the variational optimal 
control problem is proposed and solved. In section 5 the results obtained in 
the previous sections are particulary studied in the discrete and quantum cases, 
where two examples are analyzed in details. Finally, section 6 contains our 
conclusions. 

2 Preliminaries 

A time scale is an arbitrary closed subset of the real line K. Thus the real 
numbers and the natural numbers, N, are examples of a time scale. Throughout 
this article, and following [10], the time scale will be denoted by T. The forward 
jump operator cr : T ^ T is defined by 

cr(i) := inf{s eT : s>t}, 

while the backward jump operator p : T ^ T is defined by 

p{t) sup{s eT:s<t}, 

where, inf = supT (i.e. a{t) = t if T has a maximum t) and sup0 = inf T 
(i.e p{t) = i if T has a minimum t). A point t € T is called right-scattered if 
t < (j(t), left-scattered if p{t) < t and isolated if p{t) < t < (j{t). In connection 
we define the backward graininess function v :T [0,cxd) by 

=t-p(t). 

In order to define the backward time scale derivative down, we need the set 
Tk which is derived from the time scale T as follows: if T has a right-scattered 
minimum to, then = T — {m}. Otherwise, T„ — T. 
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Definition 2.1. [5] Assume / : T ^ K. is a function and t E T^. Then th.e 
backward time-scale derivative (t) is tlie number (provided it exists) with 
the property that given any e > 0, there exists a neighborhood U oi t (i.e, 
U — {t — 5,t + 5) for some (5 > 0) such that 

- fipim - - Pirn < - Pit)\ for aU s e [/ (1) 

Moreover, we say that / is (nabla) difFerentiable on provided that f^{t) 
exists for all t e T^. 

The following theorem is Theorem 3.2 in f9^ and an analogue to Theorem 
1.16 in [TU]. 

Theorem 2.2. Assume / : T ^ R is a function and t e T^. Then we 
iiave tie following: 

(i) If f is differentiable at t then f is continuous at t. 

(ii) If f is continuous at t and t is left-scattered, then f is differentiable at 
t with 

,V.,^ _ fit) - fjpjt)) 
^ -it) 

(Hi) If t is left-dense, then f is differentiable at t if and only if the limit 

limM_M 

s^t t — S 

exists as a finite number. In this case 

/V(,).linrM^ 

s->t t — S 

(iv) If f is V- differentiable at t, then 

f{t)^f{p{t))+v{t)r{t) 

Example 2.3. (i) T = M or any any closed interval (The continuous case) 
ait) = p{t) - t, y{t) = and (t) = f'{t). 

(a) T = hZ, h > or any subset of it. (The difference calculus, a discrete 
case)a{t) =t + h, p{t) = t-h, u[t) = h and (t) = Vhfit) = f{t)-f{t~h). 

(Hi) T = Tq = {g" : n e Z} U {0}, < g < 1, (quantum calculus) 

a{t) - q-H, Pit) - qt, uit) - (1 - q)t and f^H) = V,/(t) = ^%Z{\f . 

(iv) T = T'^ ^ {q>^ - Etol'f^ : fc > 2,fc G N} U {^}, < q < 
1, h > (unifying the difference calculus and quantum calculus), ait) — 
q-\t + h),pit) = qt-h, vit) = i\-q)t + h and ^t) = V,V(i) = ^^^E^^- 

If ao £N then = q'^H - Efc=o^ l'''^ so S/'^p^^'it) = q"° . Note that 

in this example the backward operator is of the form pit) = ct + d and hence 
is an element of the class H of time scales that contains the discrete, the 
usual and the quantum calculus (see f J4|). 
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Theorem 2.4. Suppose /, g : T ^ R are nabla differentiable at t E T„. 
Then, 

1. the sum / + g : T ^ R is nabla differentiable at t and (/ + g)^ {t) ~ 

r{t)+9^{t); 

2. for any A € R, the function A/ : T ^ R is nabla differentiable at t and 

3. the product fg:T^M. is nabla differentiable at t and 

if 9)^ - r{t)9{t) + nt)g^{t) = r{t)9'{t) + f{t)9^{t) 
For the proof of the foUowing lemma we refer to [Tj: 

Lemma 2.5. Let T be an H—time scale (In particular T = T^), / : T ^ R 
two times nabla differentiable function and 9{t) = p"°{t), for ao E N. Then 

{fo9)^{t)^r{g{t)).9^{t), teT^ 

Throughout this article we use for the time scale derivatives and integrals 
the symbol which is inherited from the time scale T^. However, our results 
are true also for the H— time scales (those time scales whose jumping operators 
have the form at + b). The time scale is a natural example of an H— time 
scale. 

Definition 2.6. A function F : T ^ R is called a nabla antiderivative of 
/ : T ^ R provided F{t) = /(t), for aU t e T^. In this case, for a, 6 € T, we 
write ^ 

/ fit)Vt:^Fib)-Fia) 

The following lemma which extends the fundamental lemma of variational 
analysis on time scales with nabla derivative is crucial in proving the main 
results. 

Lemma 2.7. Let g € Cm, g : [a, 6] ^ R". Then 

/ for aU r] e with r]{a) = ri{b) = (2) 

J a 

holds if and only if 

9{t) = c on [a, 6]k for some c €E R" (3) 

The proof can be achieved by following as in the proof of Lemma 4.1 in [8], 
( see also [H]). 
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3 First order Euler-Lagrange equation with de- 
lay 

We consider the T^-integral functional J : 5 ^ M, 

J(y)= rL(a;,y''(x),VS(a;),y''(p««(a;)),VS((p««(a;))V> (4) 



where 

a,5e T^,a < p"°{b) < b 
L ; [a, b] X (R")4 ^ R and yP{x) = 2/(/9(a;)) 

and 

S = {y: [p"°{a),b] ^ K" : y{x) = (Va: G [p""(a),a]) and 2/(6) - Cq} 

We shaU shortly write : 

Lix) ^ L{x, /(x), Vjy(:r), /(p"" (x)), V'^yHp"" {x)) 

We calculate the first variation of the functional J on the linear manifold 
S: hetrje H = {h: [p°">ia),b] ~> K" : h{x) (Vx G [p"" (a), a] U {fe}) }, then 

6J{y{x),r]{x)) = ^ J(y(a;) + e?7(x))|,=o 

(5) 

where 

;^ r ;^ t « r ^ . , 



9(2/P(x))' diV^yix))' 9(yP(p"o(x))) 9(V^2/(p"o(a;))) ' 

and where Lemma 1^31 and that V^/9"°(i) = q"" are used. If we use the change 
of variable u = p°'°(x), which is a linear function, and make use of Theorem 
1.98 in [10] and Lemma [2751 we then obtain 

SJ{y{x),rj{x)) = / [diLix)rjPix)+d2L{x)V^g7j{x)]V''^x+ 

J a 

J a 
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where we have used the fact that 77 = on [p"°(a), a]. 

Sphtting the first integral in ([6]) and rearranging will lead to 

fP"" (b) 

5J{y{x),r^{x)) = / [d,L{xW{x) 



+a2L(x)V^r7(a;)+g-""a3L((p"«)-i(.T))7;''(a;)+g-"«a4L((p"")-i(x))V^77(a;)]V^x 
+ [diL{x)rjPix)+d2Lix)v!^rjix)]V'^x (7) 

Jp°o(6) 

If we make use of part 3 of Theorem 12.41 then we reach 

5J{y{x),'n{x)) = 



fp°«(b) r 

d2L{x)W'^f^{x) + g-"''94i((p"'')-^(x))Vjr?(x) + / d,L{z)W'^^z.7j{x)] 



aii(z)V>.V>(a;) + q-"°V,^[ / a3L((p"")-i(z))V>.7?(.T)]- 



ra3i((p"")-'W)V;;z.V,^(a:)jv>+ r (8) 

J a J Jp°o(6) 

I a2L(x)Vj77(x) + V^M r 9ii(z)V^^z.r;(x)] - f 9ii(z)V^^z.V^77(x) 1 Vjx 

[ ■/p°o(6) 7p°o(b) J 

(9) 

In the above equations ((S]),®, once choose 77 such that 77(a) = and 7; = on 
[q°'°b, b] and in another case choose r] such that r/(6) = and r/ = on [a, q°'°b], 
and then make use of Lemma 12.71 to arrive at the following theorem: 

Theorem 3.1. Let J : S ^ K. be the T'^ -integral functional 

J{y)= ri(x,y''(x),V,^y(x),y''(p"°(a;)),V^'2/((p"«(a;))Vjx (10) 

J a 

where 

a,beT\,a< p°">{b) < b 
L : [a, b] X (R")-* ^ R and yP{x) ^ y(p{x)) 

and 
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S^{y: [p""(a),6] ^ M" : y{x) = ^{x) (Vx e [p"°{a),a]) and y{b) = cq}. 

Then the necessary condition for J{y) to possess an extremum for a given 
function y{x) is that y{x) satisfies the following Euler-Lagrange equations 

V'^d2L{x)+q~"'>W'^diL{{p''«)-\x)) = diL{x)+q-""d3L{{p''<')-\x)), {xe [a,p""{b)l 

(11) 

and 

V'gd^Lix) = 9iL(a;) (x e (12) 
Furthermore, the equation 

(Z-"°54L((p"«)-i(x))ry(x)|f°W =0 (13) 

holds along y{x) for all admissible variations ri{x) satisfying rj{x) =0, a; G 
[p"«(a),a]U{6}. 



The necessary condition represented by (|13p is obtained by applying inte- 
gration by parts in ([7]) and then substituting equations PD) and (|12p in the 
resulting integrals. The above theorem can be generalized as follows: 

Theorem 3.2. Let J : S"" ^ R be the T'^-integral functional 
J{yi.y2,--,yrn) ^ L{x,y{{x), 

J a 

wiiere 



and 



L : [a, b] X (R")-*™ ^ M and j/''(x) ^ 2/(/9(a;)) 

S"' = {y = {yi,y2, ■■■,ym) ■ 



: [p"°(a),b]^R'',y,{x) =ip,{x) (Vx G [p"" (a), a]) andy,(b) = c,,i = 1,2, ...,m}. 

Then a necessary condition for J{y) to possess an extremum for a given func- 
tion y{x) = {yi{x),y2{x), ...,ym{x)) is that y{x) satisfies the following Euler- 
Lagrange equations 

V%L\x) + q-'^°V'ldiV{{p'-'')-\x)) = 
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diL\x) + q-'''^d:,L\{p'''^)-\x)), {x& [a,p«''(6)]«) (15) 

and 

Vp2L\x) = diV{x) {x G [p''"{b),bU) (16) 
Furthermore, the equations 

q-"'>d4L\{p-'^)-\x))vi{x)\C^'''> = (17) 
hold along y{x) for all admissible variations rii{x) satisfying 
r]i{x)=0, xe [p°"'{a),a\U{b},i= 1,2,. ..,m 

where 



diL = ^, n, d2L' = , SsL' = ^, o- , andd^L 



d{y^{x)y diV^Viix))' ' 5(yf(p«o(x))) a(V>,(p"o(a;))) ' 

4 The optimal-control problem 

Our aim in this section is to find the optimal control variable u{x) defined on 
the il— time scale, which minimizes the performance index 

J{y, u) = f L{x, y'{x),uPix), y^p"" (x)), V^2/((p«° (a;))V> (18) 
subject to the constraint 

V''^y{x) = G{x,yP{x),u''{x)) (19) 

such that 

2/(6) = c, y{x) = 0(x) X e (a), a]) (20) 
a,beT'^,a< p''°(b) < b 

L : [a, b] x (M")^ ^ M and y''(a;) = y{p{x)) 

where c is a constant and L and G mv functions with contimions first and 
second partial derivatives with respect to all of their arguments. To find the 
optimal control, we define a modified performance index as 

I{y,u) = [\L{x,yf{x),uP{x),yf{p^°{x)),W''^y{{p^°{x)) 

J a 

+ XP{x){V'^y{x)^G{x,yPix),u''{x)))]V'^^x (21) 
where A is a Lagrange multiplier or an adjoint variable. 
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Using the the equations pT|) . and of Theorem 13.21 with m = 

3, (2/1 =2/, 2/2 = 2/3 = •^) I the necessary conditions for our optimal control 
are (we remark that as there is no any time scale derivative of u{x), no boundary 
constraints for it are needed) 



(22) 
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^""" a(2/P((p-o(,)) ((^"°)"(-))=»- (x.[«,p-(6)]«) 



and 



and also 



Note that the condition (|25p disappears when the Lagrangian L is free of 
the delayed time scale derivative of y. 



5 The discrete and quantum cases 

We recall that the results in the previous sections are valid for time scales whose 
backward jump operator p has the form pix) = qx — h, in particular for the 
time scale T^. 

(i) The discrete case: If g = 1 and h > (of special interest the case when 
h = 1), then our work becomes on the discrete time scale hZ = {hn : n e Z}. 
In this case the functional under optimization will have the form 

6 

J''{y)^h L{th,y{{t-l)h),V''y{ih),y{th-{d+l)h),V''y{th-dh)) 

i—a+l 

a,b e Z,d eN and a <b - d <b, 

and that y{bh) = c, y{ih) — ip{ih) for a — d < i < a 
where 

V^y{x) =y{x)-y{x-h), x e hZ. 
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The necessary condition for [y] to possess an extremum for a given func- 
tion y : {ih : i = a — d,a — d + 1, a,a + l, b} is that y{x) satisfies 
the following h-Euler-Lagrange equations 

W''d2L{ih)+\/''d4L{{i+d)h) = diL{ih)+d3L{{i+d)h), {i = a+1, a+2, b-d) 

(26) 

and 

V^d2L{ih) = diL(ih) {i = b-d+l,b-d + 2,..,b) (27) 
Furthermore, the equation 

d4L{bh)r]{{b - d)h) - diL{{a + d)h)r]{ah) = (28) 

holds along y{x) for all admissible variations r}{x) satisfying r}{ih) = 0, i & 

{a — d,a — d+1, a} U {b}. 

In this case the h-optimal-control problem would read as: 

Find the optimal control variable u{x) defined on the time scale /iZ, which 

minimizes the h-performance index 

6 

J''{y,u) = h L{ih,y{{i-l)h),u{{i-l)h),y{ih-{d + l)h),V^y{ih-dh)) 

i=a+l 

a, 6 e Z, e N and a < 6 - d < 6, (29) 
subject to the constraint 

V^y{ih) = G{ih,y{{i-l)h),u{{i-l)h)), i = a + l,a + 2,...,b (30) 

such that 

y{bh) = c, y{ih) = 4'{ih), {i = a — d,a — d + 1, ...,a) (31) 

a,b €'N,a <b- d <b 
The necessary conditions for this h-optimal control are 

dL dL 
dy{{t-l)h) d{y{{i - d - l)h) 

BC BT 

= 0, (i = b-d+1, b-d+2, , 
(33) 



10 



and 

dL dL 

and also 



V''y{ih) = G{ih,y{{i - l)h),u{{i - l)h)), i = a + l,a + 2, ...,b 

Note that the condition p5p disappears when the Lagrangian L is indepen- 
dent of the delayed V'' derivative of y. 

Example 5.1. In order to illustrate our results we analyze an example of 
physical interest. Namely, let us consider the following discrete action, 

h 

J''{t) = 2 XI - V{y{ih -{d+ l)h)), a,beN, a<b-d<b 

i—a-\-l 

subject to the condition 

y{bh) = c, y{ih) = ip{ih), for i = a — d,a — d + 1, a 
The corresponding h-Euler-Lagrange equations are as follows: 

dV 

y{^hy2y{{l~l)h)+y{{^-2)h)+ ^^^^^^^ {{i+d)h), {i = a+l, ...,b-d) 

^ ' (36) 

and 

y{ih) - 2y{{i - l)h) + y{{i - 2)h) = 0, {i ^ b - d + l,b - d + 2, ...,b) (37) 

We observe that when the delay is removed, that is d — 0, the classical discrete 
Euler-Lagrange equations are reobtained. 

(ii) The quantum case: If < (7 < 1 and h — 0, then our work becomes 
on the time scale = {g" : n G Z} U {0}. In this case the functional under 
optimization will have the form 

J,{y)^ [ L{x,y{qx),V,y{x),y{xq"^'+'),V,y{xq''<>))VgX (38) 

where 

a — q'^^^, b — q^ , a, ao G Z, a > /3 and P + ao < a, 



11 



L : [a,h]q x (M")'' R and [a,b]q = {g' : i = a + 1, a + 2, ...,/3} 

Using the V— integral theory on time scales, the functional Jq in p8|) turns 
to be 



/9 

J,(y) = (1 - g) ^ g^L(g\ V,2/(g^), V,2/(O+0) 

The necessary condition for Jq {y) to possess an extremum for a given func- 
tion y : {q^ : i = a + 1 — ao, a + 2 — ao..., a, a + 1, /?} R" is that y{x) 
satisfies the following q-Euler-Lagrange equations 

-(^) +9-"''V,— -— — ^(g-ox) = 



and 



(39) 



Furthermore, the equation 

BT 

'^'"° a(v,,(p-o(.))) (-^--)^(-)ir-=o (41) 

holds along y(x) for all admissible variations rj{x) satisfying 7]{x) =0, x G 

[g"''a,a],U{&}. 

In this case the q-optimal-control problem would read as: 

Find the optimal control variable u{x) defined on the Tg— time scale, which 

minimizes the performance index 

Jq{y,u)^ L{x,y{qx),u{qx),y{q^"+^x),^qy{q''^'+^x)\/qX (42) 

J a 

subject to the constraint 

\7'^yix)=G{x,y{qx),u{qx)) (43) 

such that 

y(6) = c, yix) = </)(a:) x G [g""a, a]) (44) 
a = 6 = ao + /3 < a + 1 
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where c is a constant and L and G are functions with continuous first and 
second partial derivatives with respect to all of their arguments. 
The necessary conditions for this q-optimal control are: 



dL dG dL 

BT 



(45) 



and 



V,AM + A(,x)^-^ = 0, («|,-MU (46) 
BT 

{q"^''xUx)\r'^Q (48) 



9Vg?/(q"«x) 
and also 

Vg2/(a;) = G{x,y{qx),u{qx)) 

Note that the condition (|48)) disappears when the Lagrangian L is indepen- 
dent of the delayed derivative of y. 

Example 5.2. Suppose that the problem is that of Ending a control 
function u{x) dehned on the time scale Tg such that the corresponding solution 
of the controlled system 

Vg2/(x) = -ry{qx) + u{qx), r > 0, (49) 

satisfying the conditions: 

y{h) ~ c, y{x) — fix), for x G [q"°a, a\q, a = q°'~^^,b — q'^,aQ+f3<a + l 
is an extremum for the q-integral functional (q-quadratic delay cost functional): 

1 ^ 

JM^)M^)) - -{l-q)Y.q'[y\q'^''"+') + u\q^+')] (50) 

2— a 

According to P7)) and {IFp, the solution of the problem satisfies: 

VgXiqx) = rX{qx) + q'""y{qx), {x G [a, g"«6]«), (51) 
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VqX{qx)^rX{qx), (x G 5],), 
X{qx) = u{qx), {x £ [a,b]g) 



(52) 
(53) 



and of course 



ry{qx) + u{qx) 



When the delay is absent (i.e ao = 0), it can be shown that the above 
system is reduced to a second order q-difference equation. Namely, reduced to 



If we solve recursively for this equation in terms of an integer power series by 
using the initial data, then the resulting solution will tend to the solutions of 
the second order linear differential equation: 



Clearly the solutions for this equation are : exp{\/ + \x) and exp{^\/r'^ + Ix). 
For details see [7j. 

6 Conclusion 

In this manuscript we have developed an optimal variational problem in the 
presence of delay on time scales whose backward jumping operators arc of the 
form pit) = qt — h, q > 0, h > 0, called iJ— time scales. Such kinds of time 
scales unify the discrete, the quantum and the continuous cases, and hence 
the obtained results generalized many previously obtained results either in the 
presence of delay or without. To formulate the necessary conditions for this 
optimal control problem, we first obtained the Euler-Lagrange equations for 
one unknown function then generalized to the n-dimensional case. The state 
variables of the Lagrangian in this case are defined on the i?— time scale and 
contain some delays. When q = 1 and h — with the existence of delay some 
of the results in [3] are recovered. When < g < 1 and h ^ and the delay is 
absent most of the results in [7] can be reobtained. When q = I and the delay 
is absent some of the results in [TT] are reobtained. When the delay is absent 
and the time scale is free somehow, some of the results in [13] can be recovered 
as well. 

Finally, we would like to mention that we followed the line of nabla time 
scale derivatives in this article, analogous results can be originated if the delta 
time scale derivative approach is followed. 
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Vgy{x) + rq{Wqy){qx) = q{r^ + l)y{qx) + qrWqy{x) 



y" - (r^ + l)y = 0. 
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